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ABSTRACT 



Talking video games can provide simulated voice dia- 
log between human players and animated characters on 
a TV screen. Two or more players can take turns re- 
sponding to animated characters and two or more ani- 
mated characters can respond to each player and to 
each other, thereby providing three-way or four-way 
conversations. Pictures and voices are generated from 
digital data separately stored on a laser-readable disk 
such as a CD-ROM in compressed form. As the game is 
played each animated character talks to the human 
game players and waits for a response. Each player has 
a hand-held controller that displays two or more 
phrases or sentences and a player responds by pressing 
a button next to a selected phrase. An animated charac- 
ter then responds to the selected phrase as if it had been 
spoken by the human player. Speech recognition is not 
required. Each scene branches to two or more subse- 
quent scenes. But within each scene there are several 
branching dialog sequences, thereby providing a large 
variety of possible dialogs. Human game players are 
thus given an illusion of having dialogs with interesting 
people, either living, historical or imaginary and with 
animal-like characters on a TV screen as an active par- 
ticipant in adventures and dramas with these characters. 

4 Claims, 10 Drawing Sheets 
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dialog and/or different characters. Successful games of 
TALKING VIDEO GAMES the past have made use of a rich variety of possible plays 

against a simple repetitive background. Chess has been 
CROSS REFERENCE TO RELATED popular for centuries with only a very basic checkered 

APPLICATION 5 background. Pac-Man did quite well even though it had 

This is a continuation-in-part of U.S. patent applica- o^Y a simple background maze. Recent video games 
tion Ser. No. 07/614,843, filed Nov. 14, 1990, aban- also make use of a repetitive background. The reason 
doned in favor of continuation application Ser. No. these games have high play value is the large variety of 
08/140,266, filed Oct. 21, 1993, pending. possible plays and sequences of plays in each situation. 

10 And so it should be with talking video games. 

TECHNICAL FIELD OF THE INVENTION It ^ common practice ^ ^ ^ for sto . 

This invention relates to video games, animated car- ries to branch. It is also common practice for digital 
toons, and picture/sound synchronization. data of animated characters to be stored separately from 

BACKGROUND OF THE INVENTION 1S ^^Z^^t^^Z 

We are all born with a desire to talk and to be talked the character data to minimize the number of stored 

to. Most of us find talking a pleasant experience and we images. 

do it more often for pleasure than for necessity. Listen- It is well known for human players to input choices 

ing to other people talk and thereby sharing their emo- using any of a variety of input devices such as push 

tional experiences is also a desire we are born with and 20 buttons, rotatable knobs, pressure sensitive membrane, 

this desire has been exploited in motion picture film and proximity sensitive pads or screen overlay, light pen, 

television in which voice sounds are now essential But light sensitive gun, joy stick, mouse, track ball, moving 

until recently, voice sounds were seldom used in video a cursor or crosshairs or scrolling through highlighted 

games or were used as an optional gimmick to add a options, speech recognition, etc. 

little realism to the game, rather than to simulate dialog. 25 Jn ^ each choice ^ hnmaTi cm be 

The large amount of memory required for good quality Mediately followed by a synthesized voice or digi- 

voice sounds has made voice impracucal for home ^ed voice recording that speaks the words selected by 

video games, untd recently . But now lower memory ^ human x SQ ^ ^ ^ ^ ^ £ 

prices and digital disks such as the CD-ROM and com- - . +u + *u t, jti.ri.--j r 

r . iT - i_ j * it ■ *j ir\ the fact that the spoken words he hears for his side of 

pression techniques have made talking video games 30 . .*r , _ _ . lv \ 

oractical dialog are initiated by his fingers rather than his 

vocal cords 

But adding voice sounds to conventional video games — , . 
is not enough to simulate a face to face voice conversa- ^ characters in video games and computer games, 
tion. A talking video game called Thayer's Quest was especially role-playmg games, are of two types: player- 
attempted in 1984 and was played from an analog laser- 35 controlled characters (or player characters) and non- 
readable video disc. One of the reasons for the commer- characters. A player-controlled character is a 
cial failure of Thayer's Quest was that each spoken human player's animated surrogate or proxy and does 
sentence was programmed to accompany only one se- what **** human P laver chooses to have him do. Non- 
quence of video frames. Since the video was not com- P laver characters are not directly controlled by a 
pressed, me maximum amount of play time was limited 40 human player, but can be indirectly influenced by a 
to about half an hour which was further reduced to a human player, either by responding to input from a 
fraction of that by the branching story. Hence, only a human player or by responding to what a player-con- 
few minutes of voice sounds were actually heard during trolled character does or says. 

the game. Whenever a human player saw a certain The prior art also includes methods for generating 
video character, the character always spoke the same 45 video images of moving lips and facial expressions on a 
words. This greatly reduced the entertainment value of talking head or other animated character. See for exam- 
the game. Another consequence of programming the P le » U.S. Pat. No. 4,884,972 issued Dec. 5, 1989 to Elon 
audio and video to be inseparable, was that branching Gasper who contemplates use in video games, 
scenes were not distinguished from branching dialog. The film and television industries already address the 
Human players were able to navigate through a maze of 50 human desire to watch and listen to important and inter- 
roads, but the game play did not feel like a conversa- esting people. But there is also a basic human desire that 
tional dialog. It was more like "Which road do you people respond to us as individuals. No industry yet 
want to take next: (1) or (2) or (3)? Make your selec- satisfies this desire that important people reply to us as 
tion." Talking video games will be much more enter- individuals. Although the telephone provides a partial 
taining if each scene has a rich variety of possible dialog 55 satisfaction of our desire to talk with other people, it is 
sequences. necessarily limited to living people who are willing to 

Talking video games are disclosed in my U.S. Pat. talk with us. Historical and imaginary people cannot 
Nos. 4,305,131; 4,333,152; 4,445,187 and 4,569,026. talk with us and famous living people don't want to. 

Another problem in the prior art is how to prevent a Hence, there is is a strong but unfulfilled human desire 
combinatorial explosion, i.e. an exponential increase of 60 waiting to be satisfied by new technology, 
scenes if each branch branches, and each of those Often an illusion is as satisfying as a real experience, 
branch, etc. If branches did not merge or loop, the as any TV viewer knows. When you watch people on 
limited amount of bytes on the CD-ROM would be TV, what you are actually watching are little flickering 
quickly exhausted after less than a dozen branches. dots of colored light from a chemically coated sheet of 
Branches should usually merge with other branches or 65 glass. The voice sounds you hear are from a vibrating 
loop back to prior scenes. But this does not mean that cone of paper. That is reality. The rest of your experi- 
repeated scenes should play exactly the same each time. ence is illusion. But it is an illusion that everyone wants 
Each time a scene is repeated there should be different to experience and will gladly pay money for. The desire 
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to talk with interesting, charismatic and famous people 

is also strong and millions of people will be satisfied EXAMPLES OF GAME DIALOG 

with an illusion of such conversations. Each scene branches to two or more subsequent 

Talking video games (talkies) will change the nature scenes, but there is also a second level of branching 

of video games as dramatically as talking pictures 5 dialog within each scene. Referring to FIG. 6 as an 

changed silent film. Talkies will let users chat with example: 

images of famous people (living or historical or imagi- The animated character looks at you anxiously from 

nary) and with animal-like characters, and participate in the TV screen. In the background is a burning car. The 

simulated adventures and dramas with interesting char- character yells to you "My mother's trapped in the car. 

acters who talk to each player responsively. The con- 10 I can't get her out. She's going to die." You the player 

versations will be one-sided, of course, with the on- can choose either: 

screen characters doing most of the talking. But talkies 0) "I've got a fire extinguisher in my car. I'll get it." 

that stir human emotions like dramatic films will have or 

lasting appeal, because they will satisfy a basic human ( 2 ) "I've got a chain in my car. We can pull the door 

desire, the desire to talk with other people. orr "-" 

Either way the character replys "Ok, but do it quick!" 

SUMMARY OF THE INVENTION and a few seconds later yells "Faster! Faster! Do some- 

This is a video game which takes the form of a thing!" 
branching story that simulates dialog between two or ^ T* 101 * depending on your selection, the character is 
more animated characters on a TV screen and two or shown using a fire extinguisher or using a chain to pull 
more human game players, thus simulating three-way me car door °P en - ° r ( see F* 0 * 7) hands reach up from 
or four-way dialog. Branching is of two kinds: scene ^ bottom of the TV screen to simulate the hands of a 
branching that results from a selected-action or a human player helpmg the animated character, 
change from one character to another and dialog 2 5 ^ next time you encounter A" 8 situation the char- 
branching within each scene. acter has been modified to seem like a different person. 

His/her personality is different. His/her voice and face 

BRIEF DESCRIPTION OF THE DRAWINGS are different (chosen by the system from a catalog of 

FIG. 1 illustrates an animated cartoon talking game voices md faces )- The burning car is a different color, 

with two human players who take turns selecting words 30 And tht dialo S nas changed. The character cries 

to say to one or two animated characters on a TV "Please help me. There's a little boy trapped in the car. 

screen who then respond to the words. Subtitles on the 1 £ et ^ door °P en " You can choose either: 

TV screen tell each player what is being said by the 0) " Loo P ***** chain though the door. Ill hook it to 

other player. my car." or 

FIG. 2 illustrates an animated talking game with one 35 ^ < 2 > " Use ^ P 1 ^ t0 W **« door °P* n " 

human player and two animated cartoon characters on Bt, Jf r wav ^ <*aracter yells "Hold on. We'll get you 

a TV screen who talk to the human and to each other. 0U lL , , , 

FIG. 3 is an animated cartoon illustrating a kissing u Then ' depending °» V** selection, the character is 

scene in which one character's unspoken thoughts are ? hown usm 8 a M« or fl cham t0 P^ 1 *« do ° r - 
sounded 40 either case the fire flares up and the character yells: 

FIG. 4 is an animated cartoon illustrating a ledge- " It,s ° ot w0 * i, » Do °° something!" You 

, . , . , A „ . , f can choose to say: 

hanging scene m which a talking cartoon character ,. s *_ • T *t 1 * » 

requires immediate action by the human player. £> *?* ^ " s atoost open." or 

i-n^ - . » * j , J J , , . (2) "It s stuck. Pull harder— Harder!" or 

FIG. 5 is an animated sequence illustrating branching ™ A 1 * t*> A - * i -1 »» 

1 . ft.*. 2 * j * 45 (3) Too late. It's going to explode, 

dialog m w^ch two cartoon characters respond to ^ite ^ there aAvo kinds of branching in each of 

sentences selected by a human player by talking to the ^ above sequences . ^ plea for help scene branches 

human player and to each other. tQ ^ ^ < 3^ EguUscr s £ ne or scene . B ut 

FIG. 6 is an animated sequence illustratmg branching ^ ^ ^ branchin m the dialog ^ ch scene . 

dialog in which one animated character responds to a Dial branching does not require different animation 

sentence selected by a human player and refers to a ^ except m mouth ^ ^ movements , but it ^ ds 

second character (not shown). intimate involvement in the dialog that scene branching 

FIG. 7 is an animated sequence showing hands simu- C3imQt provide . If each scene has a rich dialog it re- 
lating the hands of a human player performing an ac- quires mudl less vi de0 data than if each dialog branch 
tl0n * 55 required different video data. 

FIG. 8 is a flow diagram illustrating scene branching Repeatedly showing the same background and char- 

and dialog branching within each scene. acters with different dialog will expand the limited 

FIG. 9 is a pictorial view of a video game system capacity of a CD-ROM disk into a large number of 

having a CD-ROM disc drive connected to a televioson different story lines. Having the same background ap- 
or video monitor with auxilary devices for displaying ^ pear again and again is acceptable if a variety of talking 

prompting words. characters do and say different things against that back- 

FIG. 10 is an animated sequence illustrating both ground, 

dialog branching and scene branching in which one For a human player to know how to respond, the 

character is shown helping the other two characters get alternative choices can be communicated to him in 
out of a dangerous situation. 65 different ways: 

FIG. 11 is an apparatus block diagram illustrating 1. by displaying a menu of words or phrases or icons, 

flow of data and method steps to generate a cyclical either on the TV screen or on an auxiliary display, 

game play with two animated characters. giving alternative things to say to a non-player 
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character or alternative things a player-controlJed 
character will say; 

2. by a talking character giving the alternatives ver- 
bally, by asking a question or by suggesting alterna- 
tives; 5 

3. by a talking character showing the alternatives by 
holding a chain in one hand and a prybar in the 
other, for example; 

4. by one talking character making a remark to a 
second talking character (either on-screen or off- 10 
screen); 

A simulated voice dialog within each scene that does 
not require speech recognition can be of several differ- 
ent kinds: 

1. spoken voice from animated character, then push- 15 
button response from player, then voice from ani- 
mated character responding as if he had been spo- 
ken to; 

2. spoken voice from animated character, then push- 
button response from player, then voice response 20 
from game (in a different voice) to simulate the 
player's side of the conversation, then voice from 
animated character responding as if he had been 
spoken to; 

3. spoken voice from animated character, then push- 25 
button response from player, then voice from one 
animated character talking to a second animated 
character in the same scene responding to the push- 
button response; 

4. spoken voice from first animated character speak- 30 
ing to a second animated character, then push-but- 
ton response from player, then voice from the sec- 
ond character speaking the words selected by the 
player or responding to them; 

5. spoken voice from animated character, then push- 35 
button response from a first player, then echo voice 
from the game system (in a voice different from 
character) so that a second player can hear what 
the first player has "said", then voice from the 
animated character responding to the first player's 40 
input, then push-button response from a second 
player, then echo voice response from game to 
simulate second player's side of the conversation so 
that the first player can hear what the second 
player has "said"; 45 

6. spoken voice from animated character, then push- 
button response from a first player, then sub-titles 
on TV screen so that a second player can see what 
the first player has "said", then voice from an ani- 
mated character responding to the first player's 50 
sub-titles, then push-button response from the sec- 
ond player, then sub-titles to simulate second play- 
er's side of the conversation so that the first player 
can see what the second player has "said". 

A similar dialog would follow in the same scene or in 55 
the next scene with different words. By definition, each 
scene change involves a substantial change in back- 
ground or a change to another full-screen character and 
hence requires substantially different video (not just lip 
movements or showing the same background at differ- 60 
ent views or angles). Each scene should have several 
exchanges of dialog which require only minimal video 
changes such as head and lip movements. The video 
(both background and characters) may be rapidly 
changing and these changes may be the same every time 65 
a scene is repeated. But the voice sounds should be 
different and characters should say different things each 
time a scene is repeated. 



6 

Player-controlled characters say whatever the human 
player chooses to have them say, but non-player charac- 
ters should also be programmed to say many different 
alternative things depending on what a player or player- 
controlled character has just "said". A scene may loop 
a dozen times with a non-player character saying some- 
thing different each time and the alternative responses 
for each human player being different each time around 
the loop. 

Menus showing two or three or four phrases to say 
are better than the old keyword-keyword method used 
in many role-playing games because menus do not force 
each player to guess about what can be said. Guessing is 
fine for puzzle games, but is quite disrupting in role- 
playing games. Trial and error slows down the pace of 
the game, especially for other players, and weakens or 
destroys the suspense and emotional involvment that 
captivates a game player. 

Hand-held display units are preferable to displaying 
menus on the TV screen, because in two-person games 
the menu displayed to one player may be different from 
the other player's menu. Part of the fun comes from not 
knowing what choices the other player has. Also, TV 
screen menus disrupt the illusion that a player is talking 
with a real TV character. Hence, the preferred embodi- 
ment of my invention makes use of hand-held menu 
display units with one push-button for each menu item 
and echo voices to avoid sub-titles on the TV screen. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referring to FIG. 1, in one embodiment of this inven- 
tion a video game system generates for display on a TV 
screen 11 an animated picture sequence to two human 
game players. Human players 10 and 12 take turns se- 
lecting a phrase or sentence to "say" to a character or 
characters on a TV screen who then talk back respon- 
sively. In this example it is player 10's turn. Player 12's 
hand-held controller 47 is blank, indicating that she 
cannot say anything at this moment. The TV screen 
shows two animated characters traveling in a boat or 
other vehicle. The characters are talking non-player 
characters, i.e. players can "talk" to the characters who 
will then talk back, but players cannot put words in 
their mouth, in this example. Each human player holds 
a hand-held controller with three push buttons next to a 
liquid-crystal display 13, shown enlarged in FIG. 1 for 
clarity. 

As the boat scene begins, the video game system 
displays two or three or more alternative responses on 
display 13 or TV screen or other display device. While 
player 10 is deciding which button to press, a linking 
picture sequence (not shown) continues to show the 
same boat scene with one character looking back from 
the boat as if looking at player 10 standing on the dock. 
Player 10 selects one of the displayed responses (in this 
example "WHERE ARE YOU GOING?") which is 
then echoed as voice sounds or is displayed as sub-titles 
on the TV screen so that player 12 will know what 
player 10 has just said to an animated character. This 
character 18 answers responsively with voice sounds: 
"TO THE ISLAND." after which a second character 
17 responds with "WE'LL BE THERE AN HOUR." 
in response to what character 18 just said. In the pre- 
ferred embodiment the game system generates a voice 
to echo the words selected by player 10 so that player 
12 hears what player 10 has "said" to the animated 
character. When it is player 12's turn, player 12's hand- 
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held display will then show alternative words (not cally or digitally editing voice sound data before con- 
shown in FIG. 1) that she can "say" in response to what verting to audio. 

animated character 17 or 18 has said. Thus a three-way Referring to FIG. 3, when characters 17 and 18 per- 

or four-way dialog can be simulated. form an activity such as kissing, one of the characters 

When alternative words or other verbal expressions 5 may speak (with moving mouth) or think unspoken 

are shown on LCD display 13, the words may be thoughts (sounded with unmoving or unsynchronized 

blinked a few times or display 13 may be flashed by mouth) as in cloud balloon 29, responsive to the action 

alternating black and white a few times to attract a being shown or to what was said or done in the prior 

player's attention and prompt him to make a choice. Or sequence shown in FIG. 2 or in response to a phrase 

a small light-emitting diode may be blinked on and off a 1° selected from display 13. 

few times as a prompting signal. Referring to FIG. 4, in another embodiment of this 

Before each game begins, display 13 may show identi- invention a video game system generates for display on 

fying information for each player-controlled character a TV screen an animated picture sequence showing a 

so that each human player may select which character character 30 hanging by his fingers from a ledge on the 

he or she wants to play. Alternatively, each player-con- 15 outside of a building. His friends on the roof have 

trolled character may be shown on TV screen 11 and thrown him a rope which is not long enough to reach 

the question asked "Who wants to play this character?" character 30. This ledge-hanging situation sets up the 

for each character shown. The game system then re- n f xt scene shown m FIG * 5 ' m which animated 

cords which hand-held controller responds so that later characters exchange dialog with one or two human 

that character's words to say will be shown on display 20 P 1 ^? and with each other regarding character 30. 

13 only for the player who is playing that character (in t0 FIG " 5, animated picture sequences 21, 

this example player 10). A human player may also ^ ? m ^ of °* e roof scene * which two 

choose to play a player-controlled character that need f^f^ h ° W T reSCUe charact 5 

not always be on the TV screen, but who may be off. „ m FIGK * ° n u e « two ^man player participate m the 

screen (standing on the dock in FIG. 1), and can carry 25 conversation by saying" words or phrases or sentences 

j. \ 'Jr t_ A t-. t_ i_ ■ to the animated characters who then answer resnon- 

on a dialog with on-screen characters. Each echo voice . , . , ^ , 7 " \ . *\ 

. . i • r i . 11 j t_ sively and ask questions or make remarks that lead to 

is the voice of a player-controlled character. a- * : „* u 1 -m. i* ^ * 

t» r • . ttt^ -» . At _ <_ x c At _ the next mput by a player. The alternatives shown on 

Referring to FIG. 2, in another embodunot of the ^ ^ su^ested solutions to the problem posed 

mvention, a video game system generates for display on 3Q fa £ ntence 2Q «^ ^ human { J ^ 

a TV screen 11 an animated picture sequence having tQn u next tQ ^ » ^ acter £ ds 

wo or more animated fcdking characters 17 and 18. In b ^ ^ ^ tQ 18 who res £ onds 

this example, character 17 is a player^ontrolled charac- ^ tion u dkeGM at ^ human { Q ^ Qn 

ter that human player U controls. Player 12 plays the u te *hx> accompanied by display of a new menu of 

role of character 17 and can talk to character 18 and 35 alternative actions 26. When a player presses the button 

other characters in the game through character 17. next to « slide down ^ ,> character 17 comments 

Player 12 holds a hand-held controller 47 with three on this choice of action ^ sentence ^ - m seque nce 28. 

push buttons next to a liquid-crystal display 13, shown a simulated verbal dialog can continue through a 

enlarged in FIG. 2 for clarity. The game system dis- branching sequence of exchanges of words within the 

plays three alternative responses on display 13. Player 40 same scen e and the selected action may set up the next 

12 selects one of the displayed responses (in this exam- scene m a branching sequence of scenes, 

pie "KISS ME AGAIN") with push button 14. Echo Referring to FIG. 6, in another embodiment of this 

voice sounds 15 for character 17 then say the words invention a video game system generates for display on 

selected from display 13. The words are directed at a TV screen an animated picture sequence 31 and 32. 

character 18 whose voice sounds 16 then respond to 45 The picture sequence has one scene showing a burning 

character 17. car in the background and a frightened woman 17 in the 

The two animated characters 17 and 18 may respond foreground. During part 31 of the sequence the wom- 

in reverse sequence, that is, the non-player character 18 an's voice 15 says "Please help me! My mother's 

may say his line first so that the player-controlled char- trapped in the car!" The game then displays two or 

acter 17 can respond as ordered by human player 12. 50 more alternative actions on hand-held display 13 or on 

For example, after player 12 selects "KISS ME the TV screen or other display device. The human 

AGAIN", character 18 may say "WHAT DO YOU player 10 selects one of the displayed actions (such as 

WANT TO DO?" a prerequisite sentence that is not "Pry the door open") and presses the corresponding 

one of the displayed alternatives, then character 17 can push button 14 or equivalent. While the player is decid- 

respond with "KISS ME AGAIN" which is responsive 55 ing which button to press, a linking picture sequence 

to what character 18 has just said. Such reversals can (not shown) continues to show the same scene with the 

make the dialog seem more spontaneous. woman looking anxiously at the player. When the 

Echo voices or sub-titles may also be used to express player selects an action response, part 32 of the ani- 

unspoken thoughts or the thoughts of non-speaking mated sequence continues showing the same burning 

beings such as babies or animals, or inanimate objects 60 car scene with the woman's voice 16 answering respon- 

such as a thinking rock. Cloud balloon 19 represents an sively, for example: "I tried to, but I can't get it open" 

unspoken thought of character 18 in FIG. 2 which is as in voice balloon 16. 

sounded (with mouth not moving) in response to spoken Selecting a response by pushing a button 14 can result 
sentence 15 of character 17. Voice sounds for unspoken in a change to a different scene, or as in this FIG. 6 
thoughts may be electronically altered to indicate to 65 example the scene remains the same while the branch- 
players that a voice is not a normal spoken voice. For ing dialog continues. Each of the three alternative re- 
example, unspoken thoughts can be given a hollow or sponses on display 13 will result in a different answer by 
tremulous sound or a whispering sound by electron!- animated character 17. The animated sequences 31 and 
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32 are generated by the video game system by overlay- signals may be used instead of cables. System 42 in- 
ing three moving pictures: (1) the background sequence eludes a disk reader that reads digital data from a CD- 
showing the burning car with flames continually flick- ROM disk 43, or write-once disk or card or other me- 
ering, (2) a sprite or mosaic of sprites showing the dium containing digital data from which system 42 
woman character 17 moving in a natural manner against 5 generates animated picture signals; Disk 43 also in- 
the background (This motion can be the same regardless eludes digital data of compressed audio for voice and 
of the dialog) and (3) mouth and other facial sprites other sounds, synchronizing data, and digitized words 
selected (by table lookup) by the game system to be for display on units 48 and 47. Portable game system 46 
approximately hp-synchronized with voice sounds 15 with appropriate ROM program cartridge may substi- 
and 16. 10 tute for units 48 and 47. Cable 45 connects game system 
Since the player's response time is variable, sequence 42 to display unit 48, 46 or 47 and transmits alternative 
31 or 32 with a closed mouth sprite should cycle contin- prompting words or other verbal expressions for dis- 
ually until a button 14 response is made or until a time play. Cable 45 also transmits push-button 14 selection 
limit is reached, at which time a prompting picture signals to system 42. 

sequence with words such as "Hurry! Hurry!" may be 15 If portable game system 46 has only one or two avail- 
sounded and displayed with moving mouth sprites. The able push-buttons, selection from among responses 
burning car can be any object such as a damaged bus, shown on display 13 may be done as shown in FIG. 7 by 
airplane, boat, or building that provides a danger situa- pressing push-button 14 multiple times to position a 
tion. pointer 49, cursor, or other such indicator next to (or 

Referring to FIG. 7, the game system generates for 20 on) a selected sentence, 

display on the TV screen an animated sequence show- Referring to FIG. 10, in one embodiment of this in- 

ing one or more hands 36 simulating the hands of a vention a video game system generates on a video 

human player performing an action. Sequence 33 begins screen 11 several sequences of animated pictures 21, 25, 

a a new scene resulting from the manual selection made and 28 showing three talking characters engaged in a 

by player 10 in FIG. 6 of a tool to be used in FIG. 7. In 25 rescue activity. The characters have distinctive voices, 

this example, animated sequence 33 shows a hand hold- As sequence 21 begins, characters 18 and 30 are in a 

ing pipe 35 or a fire extinguisher or other such tool dangerous situation and character 17 is trying to rescue 

while the human player whose real hand 10 is illustrated them. Character 17 speaks words represented in voice 

pressing button 14 selects one of the alternative actions balloon 20 commenting on the rescue activity. A human 

shown on display 13. Note that display 13 in FIG. 7 30 player 12 in this example holds a hand-held controller 

shows alternative actions which would result in scene 47 with three push buttons 14 positioned next to corre- 

changes, but display 13 in FIG. 6 shows alternative sponding menu items on a liquid-crystal display 13. 

words or phrases to say to animated character 17 in a Two or more alternative response sentences or phrases 

common scene followed by a scene change. In FIG. 7, are shown on display 13, each being associated with one 

pressing button 14 to select "Pry the door open" results 35 of the three push buttons 14. The hand of human player 

in picture sequence 34 showing hands 36 prying open 12 is shown pressing one of the buttons 14 that selects 

the car door with pipe 35. one of the alternative sentences to be spoken by charac- 

Referring to FIG. 8, a flowchart illustrates the dis- ter 30. 

tinction between branching dialog and branching While human player 12 is deciding which button to 

scenes. For example, at dialog branch point 60 a player 40 press, a linking picture sequence (not shown) continues 

is presented with two or more alternatives to choose to show the same scene with the characters trying to 

from which correspond to the menu of verbal expres- pull up on the rope or trying to climb up the rope, 

sions displayed on hand-held controller 48 in FIGS. When player 12 selects one of the displayed alterna- 

1-7. Each of the alternative selections will result in a tive response sentences that calls for an action shown in 

different verbal response 61 or 62 by one or more of the 45 a different scene, branching to the next scene occurs 

animated characters, but does not result in a scene beginning in this example with animated picture se- 

change in this instance. However, the alternatives at quence 25. The selected sentence is sounded in the voice 

branch point 63 in FIG. 8 will result in a scene change, of player-controlled character 30 who repeats the 

either to scene 65 or to scene 66. Branch point 69 may words selected by human player 12. These voice sounds 

result in either a scene change to scene 67 or a dialog 50 are represented in balloon 23 (in this example "GRAB 

branch depending on a player's selection. Dialog THE ROPE TOM"). Tom is character 18 who is 

branching in each scene provides a large variety of shown in sequence 21 hanging dangerously onto an 

possible dialog sequences without duplicating the ani- ankle of character 30. After character 30 says the se- 

mated picture data for each dialog branch. New ani- lected sentence in balloon 23, character 18 grabs hold of 

mated picture data is needed only whenever branching 55 the rope and then responds in his voice with the words 

to a new scene occurs. If player 10 in FIG. 6 selects the "I'VE GOT IT" which are the preprogrammed words 

first of the three alternative actions shown on display for the selected sentence. These voice sounds of charac- 

13, the scene changes to the pipe scene in FIG. 7 which ter 18 are represented in balloon 24. The actions of 

corresponds to response 68 in FIG. 8. Response 68 character 18 are the preprogrammed actions for the 
includes voice sounds 16 of character 17 in FIG. 6 fol-. 60 selected sentence. If human player 12 had selected a 

lowed by a scene change and actions by a second char- different one of the alternative sentences, a different 

acter 36 in FIG. 7. scene would result and character 18 would have be- 

Referring to FIG. 9, video game system 42 is con- haved differently and spoken different response words, 
nected by cable 44 to a television or video monitor 11 The video game system next generates an animated 
and to one or more hand-held control units 48 and 47 or 65 picture sequence showing character 18 climbing the 
portable game system 46, each having three push but- rope. This climbing sequence is not shown in the draw- 
tons 14 next to a liquid-crystal display 13 snowing a ings. When character 18 reaches character 17 in se- 
variable menu of verbal expressions. Infra-red or radio quence 28, character 17 says in her voice "HOLD MY 
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ARM" (in balloon 27) and the rescue activity proceeds. expressions, and gestures, so that each character and its 

Thus, the animated characters perform or attempt to distinctive voice can be hp-synchronized with different 

perform actions and talk about these actions while both mouth movements depending on which branch the 

the actions and voice sounds are controlled directly or dialog takes. The digital data for each animated charac- 

indirectly by a human player or players. The words 5 ter may also combine body, lips, expressions, gestures 

spoken by character 17 may also be selected by a human and voice sounds. 

player from a second menu (not shown) of alternative When a human player presses one of the buttons 14 

sentences for her to say. This human player may be a (FIGS. 1, 2, 5, 6 or 7) the game system may generate a 

second player 10 as shown in FIG. 5. voice sound speaking the selected sentence as a substi- 

After the end of sequence 28, the game system gener- 10 tu te for the player's side of the dialog. The animated 

ates another animated sequence, then another sequence, character then "responds" as if the generated voice 

then another sequence, etc. in which a human player sounds had been spoken by the human player. Because 

controls, directly or indirectly, character actions and the player selects the words which m actuaUy 

voice sounds as described above for FIG. 10. sounded, he will quickly adjust to the fact that the spo- 

Refernng to FIG. 11 which is a block diagram of a 15 ken words he hears for ^ side of me m 

special-purpose apparatus for performing some of the by ms ^ rather than ^ vocal ^ ..^m 

video g^e illustrated in FIG. 1, the apparatus performs voice rep eating the selected words is important for 

steps 1 through 7 m sequence, so that the animated with mil ltiple human players so that each player 

picture sequence on the television or video screen 11 ^ hear what ^ of ^ other k has ^f to 

alternates between two characters in this example In 20 on . screen cnaracters< £ ±Q buttons 14 

step 1, animated picture generator 51 generates a video bQth a ghmM ^ ^ ^ 

of RF signal for display on video screen 11 of an am- 1 . , A , r . _ , 

. « © A y ,y."f , . ^ j , . 7: previously spoken by an animated character and also 

mated picture from digitized animated character data i + j* , . ! rr 

™ r ^ . T selects a new dialog sequence that corresponds to the 
stored m memory 70 of a first talking character. In step ■ wj ui , , ^ 
2, hand-held conttoUer 48 25 ™^*«" res P onse shown on display 13 The 
display 13 several alternative sentences or other verbal ff lecte . d ^ sequence mcludes the face and voice of 
expressions from data read via line 72 from memory 52 animated character speaking words which are re- 
storing the alternative sentences. In step 3, one of the ^ w *> th 7 e P^s elected verbal response, 
push buttons 14 generates a selection signal (indicated Alternatively sub-titles such as dlustrated on TV 
by one of lines 53) selecting a sentence from among the 30 " m , FIG ; 1 ^^^d instead of echo voices 
alternative sentences in memory 52 and also selects the *? d , be on a TV screen or on a hand-held 
corresponding (indicated by dotted lines) digitized ^P 1 ** ^ ™ * substitute for the player's side of the 
voice recordings from memory 57 and 58. In step 4, di ^? s " .„ 

voice signal generator 54 generates a signal for output """started embodiments of the invention make 
as first voice sounds from the selected digitized voice 35 use of ^ hand-^eld controller 48 having one push-but- 
recording (via line 73) in memory 57 that expresses or ton 14 for each menu item on display 13 and echo voices 
responds to the words displayed on controller 48. In to avoid sub-titles on the video or television screen, 
step 5, animated picture generator 55 generates a signal Alternatively, the menus may be shown on the video or 
for display on video screen 11 of an animated picture television screen instead of on the hand-held display and 
from digitized animated character data stored in mem- 40 be selected by players using hand-held controllers 47 
ory 71 of a second talking character. In step 6, voice ^ ^ck displays. 

signal generator 56 generates a signal for second voice Each character can be an animated cartoon, digitized 

sounds from the selected digitized voice recording (via Uve action, analog live action, a sprite or the like, and be 

line 74) in memory 58 that respond to the words gener- player controlled or not. The term "verbal expression" 

ated by voice signal generator 54. In step 7, a new set of 45 means any word, words, phrase, sentence, question, 

alternative sentences from disk or memory 59 is loaded expletive, curse, keyword, combination of keywords, 

into memory 52, 57 and 58 and the sequence of steps symbol, icon, or any meaningful human voice sound 

begins again with step 1. such as "huh?" or "hmmm" or laughter or scream. The 

To allow each background scene to be used with word kissing is used herein to mean simulated touching 

different animated characters who ran move around 50 of one animated character's mouth to another animated 

against the background scene, the digital animation data character's mouth or other body part, 

for the background scene should be stored separately Although I have described the preferred embodi- 

from the digital animation data for each character. Simi- ments of my invention with a degree of particularity, it 

larly, to allow each character to say many different is understood that the present disclosure has been made 

sentences without a scene change, the digitized voice 55 only by way of example and that equivalent steps and 

data should be independent of the animation data. In the components may be substituted and design details 

preferred embodiment, animated character video, voice changed without departing from the spirit and scope of 

sound sequences and prompting word sequences are my invention, 

generated independently from separately stored digital I claim: 

data. Dialog data that is not used in one scene may be 60 1- An electronic system for simulating voice conver- 
ged later in a different scene with the same or different sions between animated video characters, the system 
characters. The voice data may consist of sequences of comprising: 

codes or compressed digital recordings of words, (a) means for digitally storing voice sound data repre- 

phrases, word segments or phonemes in several distinc- senting a plurality of sentences, phrases, word seg- 

tive voices so that each character can speak thousands 65 ments or phonemes for two or more talking ani- 

of preprogrammed words or sentences. Similarly, the mated characters; 

digital data for each animated character's body may be (b) means for digitally storing a preprogrammed 

stored separately from sprite data for moving lips, facial branching dialog between said animated charac- 
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ters, each branch comprising a plurality of alterna- 
tive verbal expressions; 

(c) means for generating a video or RF signal repre- 
senting images of said animated characters for dis- 
play on a video screen; 5 

(d) cable means for sending to a hand-held portable 
game apparatus variable menus of alternatively 
selectable verbal expressions, each expression cor- 
responding to a branch in said dialog; 

(e) cable means for receiving from said hand-held 10 
portable game apparatus a manually initiated signal 
representing a selected verbal expression in a menu 
of said verbal expressions, thereby selecting a 
branch in the dialog; 

(f) means for digitally reading from said catalog of 15 
voices voice sound data that corresponds to said 
selected verbal expression for the voice of one of 
said characters; 

(g) means for generating an audio signal from said 
voice sound data representing the voice of a char- 
acter speaking said selected verbal expression; and 

(h) said hand-held portable game apparatus compris- 
ing: 

(1) two or more manually operatable push buttons; 

(2) a liquid crystal display positioned near said push 
buttons for displaying said variable menu of ver- 
bal expressions; 

(3) a ROM program cartridge storing a program of 
instructions for performing the following se- 
quence of steps in said portable game system: 

a. reading said variable menu of verbal expres- 
sions from said cable; 

b. displaying said menu on said liquid crystal 
display; 

c. receiving from one of said push buttons a 
manually initiated selection signal; and 

d. transmitting said manually initiated selection 
signal on said cable; 

thereby selecting from said digital storing means 40 
the next branch of the branching dialog and 
voice sound data corresponding to the manually 
selected menu expression. 
2. A method of electronically simulating voice con- 
versations between an on-screen talking animated char- 45 
acter and an offscreen talking character, the words of 
the characters being selected by two corresponding 
human players, comprising the steps of: 

(a) digitally storing a catalog of distinctive voices for 

at least two talking characters, each in the form of 50 
voice sound data representing a plurality of sen- 
tences, phrases, word segments or phonemes; 

(b) digitally storing a preprogrammed branching dia- 
log between the on-screen character and the off- 
screen character, each branch comprising a plural- 55 
ity of alternative verbal expressions; 

(c) generating a video signal representing an image of 
said on-screen character for display on a video 
screen; 

(d) displaying on a first hand-held controller appara- 60 
tus a first set of alternatively selectable verbal ex- 
pressions, each corresponding to a branch in said 
dialog; 

(e) receiving from said first hand-held controller a 
manually initiated signal representing a first se- 
lected verbal expression in said first set of verbal 
expressions, thereby selecting a branch in the dia- 
log; 
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(f) digitally reading from said catalog of voices first 
voice sound data that corresponds to said first se- 
lected verbal expression for the voice of said on- 
screen character; 

(g) generating an audio signal from said first voice 
sound data representing the voice of said on-screen 
character speaking said first selected verbal expres- 
sion; 

(h) displaying on a second hand-held controller appa- 
ratus a second set of alternatively selectable verbal 
expressions that follows next for said off-screen 
character in the selected branch of the dialog; 

(i) receiving from said second hand-held controller a 
manually initiated signal representing a second 
selected verbal expression in said second set of 
verbal expressions, thereby selecting a next branch 
in the dialog; 

(j) digitally reading from said catalog of voices sec- 
ond voice sound data that corresponds to said sec- 
ond selected verbal expression for the voice of said 
off-screen character; and 

(k) generating an audio signal from said second voice 
sound data representing the voice of said off-screen 
character speaking said second selected verbal 
expression. 

3. A method of electronically simulating voice con- 
versations between at least two on-screen talking ani- 
mated characters and an off-screen talking character, 
comprising the steps of: 

(a) digitally storing a catalog of distinctive voices for 
at least three talking characters, each in the form of 
voice sound data representing a plurality of sen- 
tences, phrases, word segments or phonemes; 

(b) digitally storing a preprogrammed branching dia- 
log between a first on-screen character and a sec- 
ond on-screen character and an off-screen charac- 
ter, each branch comprising a plurality of alterna- 
tive verbal expressions; 

(c) generating a video signal representing an image of 
said first and second on-screen characters for dis- 
play on a video screen; 

(d) displaying on a first hand-held controller appara- 
tus a first set of alternatively selectable verbal ex- 
pressions, each corresponding to a branch in said 
dialog; 

(e) receiving from said first hand-held controller a 
manually initiated signal representing a first se- 
lected verbal expression in said first set of verbal 
expressions, thereby selecting a branch in the dia- 
log; 

(f) digitally reading from said catalog of voices first 
voice sound data that corresponds to said first se- 
lected verbal expression for the voice of said off- 
screen character; 

(g) generating an audio signal from said first voice 
sound data representing the voice of said off-screen 
character speaking said first selected verbal expres- 
sion; 

(h) digitally reading from said catalog of voices sec- 
ond voice sound data for the voice of said first 
on-screen character speaking the verbal expression 
that follows next in the selected branch of the dia- 
log; generating an audio signal from said second 
voice sound data representing the voice of said first 
on-screen character; 

(J) displaying on a second hand-held controller appa- 
ratus a second set of alternatively selectable verbal 
expressions that follows next for said second on- 
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screen character in the selected branch of the dia- 
log; 

(k) receiving from said second hand-held controller a 
manually initiated signal representing a second 
selected verbal expression in said second set of 
verbal expressions, thereby selecting a next branch 
in the dialog; 

(1) digitally reading from said catalog of voices third 
voice sound data that corresponds to said second 
selected verbal expression for the voice of said 
second on-screen character; and 

(m) generating an audio signal from said third voice 
sound data representing the voice of said second 
on-screen character speaking said second selected 
verbal expression. 

4. A method of electronically simulating voice con- 
versations between at least two talking characters, com- 
prising the steps of: 

(a) digitally storing a catalog of distinctive voices for 

at least two talking characters, each in the form of 20 
voice sound data representing a plurality of sen- 
tences, phrases, word segments or phonemes; 

(b) digitally storing a preprogrammed branching dia- 
log between a first animated character and a sec- 
ond animated character, each branch comprising a 25 
plurality of alternative verbal expressions; 

(c) generating a video signal representing an image of 
said first and second characters for display on a 
video screen; 

(d) displaying on a first hand-held controller appara- 30 
tus a first set of alternatively selectable verbal ex- 
pressions, each corresponding to a branch in said 
dialog; 

(e) receiving from said first hand-held controller a 
manually initiated signal representing a first se- 35 



lected verbal expression in said first set of verbal 
expressions, thereby selecting a branch in the dia- 
log; 

(0 digitally reading from said catalog of voices first 
voice sound data that corresponds to said first se- 
lected verbal expression for the voice of said first 
character; 

(g) generating an audio signal from said first voice 
sound data representing the voice of said first char- 
acter speaking said first selected verbal expression; 

(h) digitally reading from said catalog of voices sec- 
ond voice sound data for the voice of said second 
character speaking the verbal expression that fol- 
lows next in the selected branch of the dialog; 

(i) generating an audio signal from said second voice 
sound data representing the voice of said second 
character; 

(j) displaying on a second hand-held controller appa- 
ratus a second set of alternatively selectable verbal 
expressions that follows next for said second char- 
acter in the selected branch of the dialog; 

(k) receiving from said second hand-held controller a 
manually initiated signal representing a second 
selected verbal expression in said second set of 
verbal expressions, thereby selecting a next branch 
in the dialog; 

(1) digitally reading from said catalog of voices third 
voice sound data that corresponds to said second 
selected verbal expression for the voice of said 
second character; and 

(m) generating an audio signal from said third voice 
sound data representing the voice of said second 
character speaking said second selected verbal 
expression. 

* * * * * 
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